A variational approach to robust Bayesian interpolation
نویسندگان
چکیده
We detail a Bayesian interpolation procedure for linearin-the-parameter models which combines both effective complexity control and robustness to outliers. Robustness is obtained by adopting a Student-t noise distribution, defined hierarchically in terms of an inverse-Gamma prior distribution over individual Gaussian observation variances. Importantly, this hierarchical definition enables practical Bayesian variational techniques to concurrently determine both the primary model parameters and the form of the noise process. We show that the model is capable of flexibly inferring, from limited data, both Gaussian and more heavily-tailed Student-t noise processes as appropriate.
منابع مشابه
Development of a Model for Locating Hubs in a Competitive Environment under Uncertainty: A Robust Optimization Approach
This article explores the development of previous models to determine hubs in a competitive environment. In this paper, by comparing parameters of the ticket price, travel time and the service quality of hub airports, airline hubs are divided into six categories. The degree of importance of travel time and travel cost are determined by a multivariate Lagrange interpolation method, which can pla...
متن کاملRényi Divergence Variational Inference
This paper introduces the variational Rényi bound (VR) that extends traditional variational inference to Rényi’s α-divergences. This new family of variational methods unifies a number of existing approaches, and enables a smooth interpolation from the evidence lower-bound to the log (marginal) likelihood that is controlled by the value of α that parametrises the divergence. The reparameterizati...
متن کاملVariational Inference with Rényi Divergence
This paper introduces the variational Rényi bound (VR) that extends traditional variational inference to Rényi’s α-divergences. This new family of variational methods unifies a number of existing approaches, and enables a smooth interpolation from the evidence lower-bound to the log (marginal) likelihood that is controlled by the value of α that parametrises the divergence. The reparameterizati...
متن کاملVariational Gaussian Process Classiiers
Gaussian processes are a promising non-linear interpolation tool (Williams 1995; Williams and Rasmussen 1996), but it is not straightforward to solve classiication problems with them. In this paper the variational methods of Jaakkola and Jordan (1996) are applied to Gaussian processes to produce an eecient Bayesian binary classiier.
متن کاملA Variational Bayes Approach to Robust Principal Component Analysis
We solve the Robust Principal Component Analysis problem: decomposing an observed matrix into a low-rank matrix plus a sparse matrix. Unlike alternative methods that approximate this l0 objective with an l1 objective and solve a convex optimization problem, we develop a corresponding generative model and solve a statistical inference problem. The main advantages of this approach is its ability ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2003